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We introduce the exchangeable rewiring process for modeling time-varying networks. The process 
fulfills fundamental mathematical and statistical properties and can be easily constructed from 
the novel operation of random rewiring. We derive basic properties of the model, including 
consistency under subsampling, exchangeability, and the Feller property. A reversible sub-family 
related to the Erdos-Renyi model arises as a special case. 
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1. Introduction 

A recent influx of academic monographs [9, 11, 12,19, 21, 28] and popular books [6,10, 30] 
manifests a keen cultural and scientific interest in complex networks, which appeal to both 
applied and theoretical problems in national defense, sociology, epidemiology, computer 
science, statistics, and mathematics. The Erdos-Renyi random graph [13, 14] remains 
the most widely studied network model. Its simple dynamics endow it with remarkable 
mathematical properties, but this simplicity overpowers any ability to replicate realis¬ 
tic structure. Many other network models have been inspired by empirical observations. 
Chief among these is the scale-free phenomenon, which has garnered attention since 
the initial observation of power law behavior for Internet statistics [16]. Celebrated is 
Barabasi and Albert’s preferential attachment model [7], whose dynamics are tied to 
the rich get richer or Matthew effect. 1 Citing overlooked attributes of network sampling 
schemes, other authors [20, 31] have questioned the power law’s apparent ubiquity. Oth¬ 
erwise, Watts and Strogatz [29] proposed a model that replicates Milgram’s small-world 
phenomenon [25], the vernacular notion of six degrees of separation in social networks. 

Networks arising in many practical settings are dynamic, they change with time. Con¬ 
sider a population { u\,U 2 ,...} of individuals. For each t > 0, let Gij(t ) indicate a social 
relationship between iq and Uj and let Gt := (G,y comprise the indicators for the 
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1 “For to everyone who has will more be given, and he will have an abundance. But from the one who 
has not, even what he has will be taken away.” (Matthew 25:29, The Bible, English Standard Version, 
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whole population at time t. For example, Gij(t) can indicate whether Ui and Uj are co¬ 
workers, friends, or family, have communicated by phone, email, or telegraph within the 
last week, month, or year, or subscribe to the same religious, political, or philosophical 
ideology. Within the narrow scope of social networks, the potential meanings of G*j(i) 
seem endless; expanding to other disciplines, the possible interpretations grow. In sociol¬ 
ogy, {Gt}t>o records changes of social relationships in a population; in other fields, the 
network dynamics reflect different phenomena and, therefore, can exhibit vastly different 
behaviors. In each case, {Gt}*>o is a time-varying network. 

Time-varying network models have been proposed previously in the applied statistics 
literature. The Temporal Exponential Random Graph Model (TERGM) in [17] incorpo¬ 
rates temporal dependence into the Exponential Random Graph Model (ERGM). The 
authors highlight select properties of the TERGM, but consistency under subsampling is 
not among them. From the connection between sampling consistency and lack of interfer¬ 
ence, it is no surprise that the Exponential Random Graph Model is sampling consistent 
only under a choking restriction on its sufficient statistics [27]. McCullagh [23] argues 
unequivocally the importance of consistency for statistical models. 

Presently, no network model both meets these logical requirements and reflects empir¬ 
ical observations. In this paper, rather than focus on a particular application, we discuss 
network modeling from first principles. We model time-varying networks by stochastic 
processes with a few natural invariance properties, specifically, exchangeable, consistent 
Markov processes. 

The paper is organized as follows. In Section 2, we discuss first principles for model¬ 
ing time-varying networks; in Section 3, we describe the rewiring process informally; in 
Section 4, we introduce the workhorse of the paper, the rewiring maps; in Sections 5 and 
6, we discuss a family of time-varying network models in discrete-time; in Section 7, we 
extend to continuous-time; in Section 8, we show a Poisson point process construction 
for the rewiring process, and we use this technique to establish the Feller property; and 
in Section 9, we make some concluding remarks. We prove some technical lemmas and 
theorems in Section 10. 


2. Modeling preliminaries 

For now, we operate with the usual definition of a graph/network as a pair G := (V,E) 
of vertices and edges. We delay formalities until they are needed. 

Let r := {r t } teT be a random collection of graphs indexed by T, denoting time. We 
may think of T as a collection of social networks (for the same population) that changes 
as a result of social forces, for example, geographical relocation, broken relationships, 
new relationships, etc., but our discussion generalizes to other applications. 

In practice, we can observe only a finite sample of individuals. Since the population 
size is often unknown, we assume an infinite population so that our model only depends 
on known quantities. Thus, each T t is a graph with infinitely many vertices, of which we 
observe a finite sub-network with n = 1,2,... vertices. Since the vertex labels play 
no role, we always assume sampled graphs have vertex set [n] := {1,..., n}, where n is 
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the sample size, and the population graph is infinite with vertex set N := {1,2,...}, the 
natural numbers. 

The models we consider are Markovian, exchangeable , and consistent. 

2.1. The Markov property 

The process T has the Markov property if, for every t > 0, its pre-t and post-f u-fields are 
conditionally independent given the present state T t . Put another way, the current state 
T t incorporates all past and present information about the process, and so the future 
evolution depends on cr(r s ) s <t only through T t . 

It is easy to conceive of counterarguments to this assumption: in a social network, 
suppose there is no edge between individuals i and i' or between j and j' at time t > 0. 
Then, informally, 2 we expect the future (marginal) evolution of edges ii' and jj' to be 
identically distributed. But if, in the past, i and i' have been frequently connected and 
j and j' have not, we might infer that the latent relationships among these individuals 
are different and, thus, their corresponding edges should evolve differently. For instance, 
given their past behavior, we might expect that i and i' are more likely than j and j' to 
reconnect in the future. 

Despite such counterarguments, the Markov property is widely used and works well 
in practice. Generalizations to the Markov property may be appropriate for specific 
applications, but they run the risk of overfitting. 


2.2. Exchangeability 

Structure and changes to structure drive our study of networks. Vertex labels carry no 
substantive meaning other than to keep track of this structure over time; thus, a suitable 
model is exchangeable, that is, its distributions are invariant under relabeling of the 
vertices. 

For a model on finite networks (i.e., finitely many vertices), exchangeability can be 
induced trivially by averaging uniformly over all permutations of the vertices. But we as¬ 
sume an infinite population, for which the appropriate invariance is infinite exchangeabil¬ 
ity, the combination of exchangeability and consistency under subsampling (Section 2.3). 
Unlike the finite setting, infinite exchangeability cannot be imposed arbitrarily by aver¬ 
aging; it must be an inherent feature of the model. 

2.3. Markovian consistency under subsampling 

For any graph with vertex set V, there is a natural and obvious restriction to an induced 
subgraph with vertex set V' C V by removing all vertices and edges that are not fully 
contained in V'. The assumption of Markovian consistency, or simply consistency, for a 

2 We are implicitly ignoring the dependence between ii' and jj' for the sake of illustration. 
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graph-valued Markov process implies that, for every n£N, the restriction of T to the 
space of graphs with vertex set [n\ is, itself, a Markov process. Note that this property 
does not follow immediately from the Markov assumption for T because the restriction 
operation is a many-to-one function and, in general, a function of a Markov process need 
not be Markov. Also note that the behavior of the restriction can depend on T 
through as much as its exchangeable cr-field, which depends only on the “tail” of the 
process. 

Markovian consistency may be unjustified in some network modeling applications. This 
contrasts with other combinatorial stochastic process models, for example, coalescent 
processes [18], for which consistency is induced by an inherent lack of interference in 
the underlying scientific phenomena. Nevertheless, if we assume the network is a sample 
from a larger network, then consistency permits out-of-sample statistical inference [23]. 
Without Markovian consistency in a time-varying Markov model, the sampled process can 
depend on the whole (unobserved) process, leaving little hope for meaningful inference. 


3. Rewiring processes: Informal description 

We can envision at least two kinds of network dynamics that correspond, intuitively, to 
local and global structural changes. Local changes involve only one edge, global changes 
involve a positive fraction of edges. We say the status of edge ij is on if there is an edge 
between i and j; otherwise, we say the status is off. 

A local change occurs whenever the status of exactly one edge changes, called a single¬ 
edge update. An easy way to generate single-edge updates is by superposition of indepen¬ 
dent rate-1 Poisson processes. For each pair i <j, we let i be the arrival times 

of a rate-1 Poisson point process. At each arrival time, the status of the edge between 
i and j changes (either from ‘off’ to ‘on’ or the reverse). Doing this independently for 
each pair results in an infinite number of changes to the network in any arbitrary time 
interval, but only finitely many changes within each finite subnetwork. We call a process 
with this description a local-edge process ; see Section 7.3. 

A global change occurs whenever the status of a positive proportion of edges changes 
simultaneously. In practice, such an event might indicate a major external disturbance 
within the population, for example, spread or fear of a pandemic. Modeling such processes 
in continuous-time requires more preparation than the local-edge process. 

For an example, consider generating a discrete-time Markov chain T := {r m } m= o j i j 2 ,... 
on the finite space of graphs with vertex set [n]. At any time m, given r m = G , we can 
generate a transition to a new state G' as follows. Independently for each pair i < j, we 
flip a coin to determine whether to put an edge between i and j in G'\ if ij is on in 
G, we flip a pi-coin; otherwise, we flip a po _ coin. This description results in a simple, 
exchangeable Markov chain on finite graphs, which we call the Erdos-Renyi rewiring 
chain (Section 5.1). More general transitions are possible, for example, edges need not 
evolve independently. We use the next Markov chain as a running example of a discrete¬ 
time rewiring chain. 
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We fix n G N and regard an undirected graph G with vertex set [n] as a {0,l}-valued 
symmetric matrix (G,j)i<jj<„ such that Gu = 0 for all? = 1,..., n; that is, we represent 
a graph by its adjacency matrix with Gij := 1 {ij is on}. For any pair of graphs (G, G'), 
we can compute the statistic n := n(G, G') := (noo, ^oij «io, tt.ii), where for r, s = 0,1, 


n rs '■= ^ 1 {Gij = r and G- = s}. 


For example, noi is the number of pairs i,j for which the status of ij changes from 0 to 
1 from G to G'. We use n as a sufficient statistic to define the transition probability 


pS(G,G') 


Q,t n oo ptnoi Q/t"!! pt n io 
_|_ ( 0)T("oi+™oo) (q. -f ’ 


where a 1 '- 5 := a(a + 1) • • • (a + j — 1) and a, /3 > 0. 

The sufficient statistic n is invariant under joint relabeling of the vertices of (G, G') 
and so the transition law is exchangeable. Furthermore, Pj^p is reversible with respect 
to 

J») (r V , = (a + ^ no (a + P)^ 

a+/3,a+/3l )■ (2a + 2/3)t™ 

where n r := J2i<i<j< n = r }- J" = 0,1. The distribution arises as a mixture of 
Erdos-Renyi random graphs with respect to the Beta(a,/3) distribution. Furthermore, 
{P^Un is a consistent collection of transition probabilities and, therefore, determines 
a unique transition probability (and hence Markov chain) on the space of infinite graphs 
with vertex set N. 

Though consistency is not immediately obvious for the above family, the savvy reader 
might anticipate it: the formula for P^p involves rising factorials (i.e., Gamma functions), 
which also appear in other consistent combinatorial stochastic processes, for example, 
the Chinese restaurant process [26] and the Beta-splitting model for fragmentation trees 
[3, 24]. We need not prove consistency explicitly for this model; it follows from our more 
general construction of rewiring processes, all of which are consistent (Theorem 5.1). We 
discuss the above family further in Section 5.1. 


3.2. A more general construction 

Throughout the paper, we construct exchangeable and consistent Markov processes using 
a special rewiring measure (Section 6). In continuous-time, Markov processes can admit 
infinitely many jumps in arbitrarily small time intervals; however, by the consistency 
assumption, any edge can change only finitely often in bounded intervals. In this case, 
we can choose a cr-finite rewiring measure to direct the process. 
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4 . Preliminaries and the rewiring maps 


For n = 1,2,..., an (undirected) graph G with vertex set [n] can be represented by its 
symmetric adjacency matrix ( Gij)i<ij< n for which Gij = 1 if G has an edge between i 
and j, and Gjj = 0 otherwise. By convention, we always assume Gu = 0 for all z = 1,..., n. 
We write Q n to denote the finite collection of all graphs with vertex set [n]. 

On C? n , we define the following operation of rewiring. Let w := ( Wij)i<i,j<n be an 
n x n symmetric matrix with entries in {0,1} x {0,1} and all diagonal entries (0,0). For 
convenience, we write each entry of w as a pair Wij := (urh , u;b), 1 < i,j < n. We define 
a map w :Q n —>• Q n by G i —> G' := w(G ), where 


r<’ _J w ij’ 

u io ■— 1 »..i 


G^ — 0 , 

Gij = 1 , 


1 <i,j <n. 


(4.1) 


More compactly, we may write w(G) := (wT 3 )i<i,j< n - We call w a rewiring map and 
w{G) the rewiring of G by w. We write W n to denote the collection of all rewiring maps 
Qn —> Qn , which are in one-to-one correspondence with n x n symmetric matrices with 
entries in {0,1} x {0,1} and all diagonal entries (0,0). 

The following display illustrates the rewiring operation in (4.1). Given G £ Q n and 
w £ W„, we obtain w(G) by choosing the appropriate element of each entry of w : if 
Gij = 0, we choose the left coordinate of Wij ; if Gij = 1, we choose the right coordinate 
of w^. For example, 


G w w(G) 


a 
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1 
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V(0,1) 

(1,0) 

(0,0) 

(1,0) 

(0,0)V 

Vi 

0 

0 

1 

0/ 


A unique symmetric nxn matrix determines each element in Q n and W ra , and so there 
is a natural restriction operation on both spaces by taking the leading mx m submatrix, 
for any m <n. In particular, we write 


Rrn,nG ’. — Cr|[ m ] '. — {Gij')%<,i 1 j< r ni G ^ Qm and 

^l[m] •— ) l <i.j<.m • W £ IVn? 


(4.2) 


to denote the restrictions of G £ Q n and w £ W„ to Q m and FV m , respectively. These 
restriction operations lead to the notions of infinite graphs and infinite rewiring maps as 
infinite symmetric arrays with entries in the appropriate space, either {0,1} or {0,1} x 
{0,1}. We write Qoo to denote the space of infinite graphs, identified by a {0, l}-valued 
adjacency array , and Woo to denote the space of infinite rewiring maps, identified by a 
symmetric {0,1} x {0, l}-valued array with (0,0) on the diagonal. 
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Any w G Woo acts on Goo just as in (4.1) and, for any G G Goo, the rewiring operation 
satisfies 

w(G)|[n] =iu|[„](G|[„]) for all n G N. 

The spaces Goo and Woo are uncountable but can be equipped with the discrete a- 
algebras cr(lJ ngN C/ ra } and cr(lJ ngN W„), respectively, so that the restriction maps j[ n i 
are measurable for every n G N. Moreover, both Goo and Woo come equipped with a 
product-discrete topology induced, for example, by the ultrametric 

d(w,w') := 1/max{n G N: u>|[ n ] = u/|[ n ]}, w,w' G Woo- (4.3) 

The metric on Goo is analogous. Both Goo and Woo are compact, complete, and separable 
metric spaces. Much of our development hinges on the following proposition, whose proof 
is straightforward. 

Proposition 4.1. Rewiring maps are associative under composition and Lipschitz con¬ 
tinuous in the metric (4-3), with Lipschitz constant 1. 

4.1. Weakly exchangeable arrays 

Let denote the collection of finite permutations of N, that is, permutations a: N —>• N 
for which #{i G N: <j(i) ^fii} < oo. We call any random array A := (Wj)i,j>i weakly 
exchangeable if 

X is almost surely symmetric, that is, Ay = A ji for all i,j with probability one, 


and 

A =c X a := (A tr(i)o(j) )i,j>l for all finite permutations cr: N —>• N, 

where =c denotes equality in law. Aldous defines weak exchangeability using only the 
latter condition; see [2], Chapter 14, page 132. We impose symmetry for convenience - 
in this paper, all graphs and rewiring maps are symmetric arrays. 

From the discussion in Section 2.2, we are interested in models for random graphs T 
that are exchangeable, meaning the adjacency matrix (Ty )j,j>i is a weakly exchange¬ 
able {0, l}-valued array. Likewise, we call a random rewiring map W exchangeable if its 
associated {0,1} x {0, l}-valued array (Wy )jj>i is weakly exchangeable. 

de Finetti’s theorem represents any infinitely exchangeable sequence Z := \ in a 

Polish space S with a (non-unique) measurable function g : [0, l] 2 —> S such that Z =c Z*, 
where 

z * -=9{oi,T]i), i> 1, (4.4) 

for {a’,(r]i)i> i} independent, identically distributed (i.i.d.) Uniform random variables 
on [0,1]. The Aldous Hoover theorem [1, 2] extends de Finetti’s representation (4.4) to 
weakly exchangeable 5-valued arrays: to any such array A, there exists a (non-unique) 
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measurable function /: [0, l] 4 —» S satisfying /(•, b, c, •) = /(•, c, 6, •) such that X =c X*, 
where 

x *j '■= i,3> 1, (4-5) 

for {a; (rji)i> i; (A{j,n)i>j>i} i-i-d. Uniform random variables on [0,1]. 

The function / has a statistical interpretation that reflects the structure of the random 
array. In particular, / decomposes the law of X A into individual row rji, column 

rjj, and overall a effects. The overall effect plays the role of the mixing measure in the de 
Finetti interpretation. If g in (4.4) is constant with respect to its first argument, that is, 
g(a , •) = g(a •) for all a, a' £ [0,1], then Z* constructed in (4.4) is an i.i.d. sequence. Let¬ 
ting g vary with its first argument produces a mixture of i.i.d. sequences. A fundamental 
interpretation of de Finetti’s theorem is: 

every infinitely exchangeable sequence is a mixture of i.i.d. sequences. 

Similarly, if / in (4.5) satisfies f(a, -,-,■) = f(a', •,■,■) for all a, a' £ [0,1], then X* is 
dissociated , that is 

X*|[ n ] is independent of -X’*|{ n +i,n-i- 2 ,...} for all n £ N. (4.6) 

The Aldous- Hoover representation (4.5) spurs the sequel to de Finetti’s interpretation: 

every weakly exchangeable array is a mixture of dissociated arrays. 

See Aldous [2], Chapter 14, for more details. We revisit the theory of weakly exchangeable 
arrays in Section 6. 


5. Discrete-time rewiring Markov chains 

Throughout the paper, we use the rewiring maps to construct Markov chains on Qoo. 
From any probability distribution uj n on W n , we generate W \, IU 2 ,... i.i.d. from ta n and 
a random graph r 0 £ Q n (independently of W\, W 2 , ■■■)■ We then define a Markov chain 
0 , 1 , 2 ,... on Q n by 

r m ;= w m (r ro _!) = (w m o • • • o Wi)(r 0 ), m>i. (5.1) 

We call io n exchangeable if W ~ uj n is an exchangeable rewiring map, that is, W =c W a 
for all permutations a:[n]—> \n\. 

Proposition 5.1. Let uj n be an exchangeable probability measure on W n and let T := 
{r m } m=0 ,i, 2 ,... be as constructed in (5.1) from an exchangeable initial state Fo and 
Wi, W 2 ,... i.i.d. from uj n . Then T is an exchangeable Markov chain on Q n with transition 
probability 


P w „(G,G'):=o Jn ({W£W„: W(G)=G'}), 


G, G' £ Q n - 


(5.2) 
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Proof. The Markov property is immediate by mutual independence of T 0 , Wi, W 2 , 

The formula for the transition probabilities (5.2) follows by description (5.1) of T. 

We need only show that T is exchangeable. By assumption, To is an exchangeable ran¬ 
dom graph on n vertices, and so its distribution is invariant under arbitrary permutation 
of [n]. Moreover, the law of W ~ oj n satisfies W =c W a and, for any fixed w £ and 
er £ y n , G' := w(G) satisfies 

U ij — ~ W cr(i)a(j) ’ 

the ij-entry of w a (G a ). Therefore, W <T {G G ) = W(G) ,T and, for any exchangeable graph 
T and exchangeable rewiring map W, we have 

W(T) a = W a (T a )= c W(T) for all cr £ y n . 

Hence, the transition law of T is equivariant with respect to relabeling. Since the initial 
state To is exchangeable, so is the Markov chain. □ 

Definition 5.1. We call {r m } m= o,i, 2 ,... an w n -rewiring Markov chain. 

From the discussion in Section 4, we can define an exchangeable measure on W„ 
as the restriction to W„ of an exchangeable probability measure u> on W 00 , where 

w (">(W):=w({r eWoo: W*\ [n] = W}), W £W n . (5.3) 

Denote by the transition probability measure of an -rewiring Markov chain on 
Q n , as defined in (5.2). 


Theorem 5.1. For any exchangeable probability measure ui on Woo, a 

consistent family of exchangeable transition probabilities in the sense that 

p( m \G,G') = P<r\G*,Ry] n (G')), G,G'eS m , forallm<n , (5.4) 

for every G* £ R~* n (G) := {G" £ G n : G" |[ m ] = G}, where R m ,„ is defined in (4-2). 

Proof. Proposition 5.1 implies exchangeability of {P^' 1 } n efi- It remains to show that 
{P<£ n) }n€N satisfies (5.4). By (5.2), 

Pi n \G,G'):=J n \{W£W n : W(G) = G'}), G,G' £ Q n . 

Now, for any m < n, fix G, G' £ Gm and G* £ R~)„(G). Then (5.4) requires 

ojW({W£W n : f(G*)eR ra ;„(G')))= W W({lfeW m : W(G) = G'}), 
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which follows by definition (5.3) of To see this, note that 

co(^({WGW n : W\ [m] (G)=G'})=u J ({WeW 00 : (W\ W )| H (G) = G'}) 

= u({W£W 00 : W\ [m] {G) = G'}) 

= w w ({FeW m : W(G) = G'}). 

This completes the proof. □ 

Remark 5.1. The consistency condition (5.4) for Markov chains is exactly the necessary 
and sufficient condition for a function of a Markov chain to be a Markov chain, as proven 
in [8]. Before describing the measure uj from Theorem 5.1 in further detail, we first show 
some concrete examples of rewiring chains. 

5.1. The Erdos—Renyi rewiring chain 

For any 0 < p < 1, let e p denote the Erdos-Renyi measure on t/oo, which we define by its 
finite-dimensional restrictions Ep 1 ' 1 to Q n for each n£N, 

4 n) (G):= p^l-p) 1 "®*, Ge£„. (5.5) 

Given any pair (po,Pi) £ [0,1] x [0,1], the ( po,pi)-Erdos-Renyi chain has finite¬ 
dimensional transition probabilities 

PW P1 (G,G , ):= I] pj«(l-PGy) 1 "^, G,G’eS n . (5.6) 

l<z<. 7 <n 


Proposition 5.2. For 0 < po,pi < 1, the (po,Pi)-Erdos-Renyi rewiring chain has unique 
stationary distribution e q , with q :=po/(l — p± +Po). 

Proof. By assumption, both p 0 and p\ are strictly between 0 and 1 and, thus, (5.5) 
assigns positive probability to every transition in Q n , for every n £ N. Therefore, each 
finite-dimensional chain is aperiodic and irreducible, and each possesses a unique station¬ 
ary distribution 9^ n \ By consistency of the transition probabilities {Ppulm }neN (Theo¬ 
rem 5.1), the finite-dimensional stationary measures must be exchangeable and 

consistent and, therefore, they determine a unique measure 9 on Qoo, which is stationary 
for P Po , Pl - Furthermore, by conditional independence of the edges of G', given G, the 
stationary law must be Erdos-Renyi with some parameter q G (0,1). 

(n) 

In an £ q '-random graph, all edges are present or not independently with probability 
q. Therefore, it suffices to look at the probability of the edge between vertices labeled 1 
and 2. In this case, we need to choose q so that 


qp! + (1 - q)p 0 = q, 


Time-varying network models 


11 


which implies g = Po/(1 — Pi + po) • 


□ 


Remark 5.2. Some elementary special cases of the (po)Pi)-Erdos-Renyi rewiring chain 
are worth noting. First, for (po,Pi) either (0,0) or (1,1), this chain is degenerate at either 
the empty graph 0 or the complete graph 1 and has unique stationary measure £q or 
£i, respectively. On the other hand, when (po,Pi) = (0,1), the chain is degenerate at its 
initial state and so its initial distribution is stationary. However, if (poj.Pi) = (1,0), then 
the chain alternates between its initial state G and its complement G (Gij)ij> i, where 
Gij := 1 — Gij for all i.j > 1; in this case, the chain is periodic and does not have a unique 
stationary distribution. We also note that when (po,pi) = (p,p) for some p G (0,1), the 
chain is simply an i.i.d. sequence of £ p -random graphs with stationary distribution e 9 , 
where q = p/ (1 — p + p) = p, as it must. 


. (n) 

For a, p > 0, we define the mixed Erdos-Renyi rewiring chain through e K a the mixture 
of Sp^-laws with respect to the Beta law with parameter (a,/3). Writing 




we derive 




4 n) (c) 


F(a + /3) 

r(a)r(/3) P 


(1 -pf-'dp 


r(a + /3) r(a + ni)r(/3 + n 0 ) 
r(a)r(/3) r(a + /3 + n) 



,/3+no (^P) 

1] 


Ojtni^no 

(a + /3)t™ ’ 


where n r := X)i <i<j< n {Gij = J"}, r = 0,1, and a 1 "" = a(a + 1) • • • (a + n - 1). For 
« 0 j An « 1 j /3i > 0, we define mixed Erdos-Renyi transition probabilities by 


p(«) 


(G,G') 


a 


t™01 

0 


/3l noo a[ nil /3i ni ° 


(a 0 + /3 0 ) t(rioo+riol) (ai + ySi)1"(”io+»«) ’ 


G, G' e G„. (5.7) 


An interesting special case takes (ao,/3o) = (/3,a) and (ai,/3i) = ( a',/3) for a,a',/3 > 0. 
In this case, (5.7) becomes 


p( ra ) 

W/3, a ),(a',/3) 


(G,G') 


a T™oo ptnoi a 'tmi ptmo 

(a + PY n ° (a' + /3)!” 1 ’ 


G,G'&g n . 


Proposition 5.3. P$ a)i(a , tP) 


is reversible with respect to e 


( n) 

a+f3,a’+P ' 
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Proof. For fixed G,G' G Q n , we write n rs := 1 {Gij = r and Gb = s} and n' rs := 

Y^icj 1 {G'^ =r and Gij = s}. Note that n' rs =n sr . Therefore, we have 


J n ) (c<\ p( n ) 
fc a+/3,Q!'+/3(/3,a),(a',/3) 


(G,G') 


Q ,T n ooy3'bioi q/Ttoi ^Ttoo 

(a + 2/J + a') tn 

O^Ko /J'Kocd'Ki £fKi 

(a + 2/3 + a') tri 

4 n i I a'^( G, )^ ( ( ;i), K> «(G / ,G), 


establishing detailed balance and, thus, reversibility. 


□ 


A mixed Erdos-Renyi Markov chain is directed by 

uj(dW):= u> PO:P1 (dW)(& 0 , 0t p 0 <g)& ai! p 1 )(dpo,dp 1 ), W G W 

J [0,1] x [0,1] 

where w POiPl is determined by its finite-dimensional distributions 

w po,pi W : = II Po^ C 1 “ Po) l ~ W ^P^ ij (1 - , W G W n , 

l<z<j<n 

for 0 < po,Pi < 1, for every n G N. 

In the next section, we see that a representation of the directing measure w as a 
mixture of simpler measures holds more generally. Notice that W ~w POjPl is dissociated 
for all fixed (j>o,pi) G (0,1) x (0,1). By the Aldous-Hoover theorem, we can express any 
exchangeable measure on Woo as a mixture of dissociated measures. 


6. Exchangeable rewiring maps and their rewiring 
limits 

To more precisely describe the mixing measure u>, we extend the theory of graph limits to 
its natural analog for rewiring maps. We first review the related theory of graph limits, 
as surveyed by Lovasz [21]. 

6.1. Graph limits 

A graph limit is a statistic that encodes a lot of structural information about an infinite 
graph. In essence, the graph limit of an exchangeable random graph contains all relevant 
information about its distribution. 

For any injection ip: [m] —> [n], m < n, and G G Q n , we define G^ := {G^(i)^u))-i<i t j< m . 
In words, G^ is the subgraph G induces on [to] by the vertices in the range of ip. Given 
G G Qn and F G G m , we define ind(E, G ) to equal the number of injections ip : [to] —>• [n] 
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such that G^ = F. Intuitively, ind(F, G) is the number of “copies” of F in G , which we 
normalize to obtain the density of F in G, 

t(F,G):= md ^ G \ F&g mi G&g n , (6.1) 

where n^ m := n(n — 1) • • • (n — m + 1) is the number of unique injections t/j : [m] —>- [n]. 
The limiting density of F in any infinite graph G £ g oo is 

t(F,G):= lim f(F,G|r„i), F £ g m , if it exists. (6.2) 

n—>oo 1 J 

The collection g* := is countable and so we can define the graph limit of 

G £ goo by 


\G\:=(t(F,G)) Feg „ (6.3) 

provided t(F , G) exists for all F £g*. Any graph limit is an element in [0, l] s , which is 
compact under the metric 

p(x,x'):=yi 2~” y^\x F -x' F \, x,x' £ [0,1] 5 ’. (6.4) 

nGN FGQru 

The space of graph limits is a compact subset of [0,1 ] s , which we denote by V*. We 
implicitly equip [0, l] e * with its Borel a-field and V* with its trace cr-field. 

Any D £ V* is a sequence where D(F) := Dp denotes the coordinate of D 

(n) 

corresponding to F £ g*. In this way, any D £ T>* determines a probability measure jjj 
on g n , for every n£N, by 


7 %\G):=D(G), G£g n . (6.5) 

Furthermore, the collection (q^jneN is consistent and exchangeable on {C/njngN an d, 
by Kolmogorov’s extension theorem, determines a unique exchangeable measure jd on 
f7oo, for which q^-almost every G £ g ^ has |G| = D. 

Conversely, combining the Aldous-Hoover theorem for weakly exchangeable arrays ([2], 
Theorem 14.21) and Lovasz-Szegedy theorem of graph limits ([22], Theorem 2.7), any 
exchangeable random graph T is governed by a mixture of 7 d measures. In particular, 
to any exchangeable random graph T, there exists a unique probability measure A on 
T>* such that T ~ 7 a , where 


7a(-) := / 7r>(-) A (d.D)- 


V* 


( 6 . 6 ) 



14 


H. Crane 


6.2. Rewiring limits 


Since {0,1} x {0,1} is a finite space, the Aldous-Hoover theorem applies to exchangeable 
rewiring maps. Following Section 6.1, we define the density of V £ W m in W £ W„ by 


t(V,W) := 


ind (V,W) 

n lm ’ 


(6.7) 


where ind(V, W) equals the number of injections if): [m] —> [n] for which W ^ = V. For an 
infinite rewiring map W £ Woo, we define 


t(V,W) := lim t(V, Wjr n i), W £ W m , if it exists. 

n—>-oo L J 

As for graphs, the collection W* := (J m gN ' s coun table and so we can define the 
rewiring limit of W £ Woo by 


\W\:=(t(V,W)) VeW ., (6.8) 

provided t(V,W) exists for all V £ W*. 

We write V* C [0, l] w to denote the compact space of rewiring limits and vy = v(V) 
to denote the coordinate of v £ V* corresponding to V £ W*. We equip V* with the 
metric 

p(v,v'):=^2 2 ~ n E \ v v-v’ v \, v,v' £ V*. (6.9) 

ne n vew n 


Lemma 6.1. Every dGV* satisfies 

• u(P) = Z){y*ew„ + iW*| w =v} z; (^*) f or every V eW n , for aline N, and 

• XV e w„ = 1 f° r every n e 


Proof. By definition of V*, we may assume that v is the rewiring limit \W*\ of some 
W* £ Woo so that v(V) = t(V, W*), for every V £ W*. From the definition of the rewiring 
limit (6.8), 


E “W= E 

weWm wew m 


lim 

n—>oo 


ind(W,W*[ H ) 

n \.m 


lim V 

n—t oo * ^ 


weWm 


ind(W,W*| M ) 

n \.m 


where the interchange of sum and limit is justified by the Bounded Convergence theorem 
because 0 < ind(W, W* | [„]) / rC m < 1 for all W £ W m . Also, for every m<n and W £ W m , 
we have 


E v (^') 

{W'eW„:W'|[m]=W} 


E 

{rew„:wj w =iv} 


lim 

k—too 


ind(W',W*| [fc] ) 

kin 


= lim E 

°° {W'eW„:W'| [m] =lV} 


ind(W',W*| [fc] ) 

kin 
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md(W,W*\ [k] ) 

= lim -—-— 

oo 

= v(W). 

This follows by the definition of ind(-, •) and also because, for any %p: [m] —> [k] there are 
kin/kirn i n j ec ti on s ip': [n] —> [fc] such that ip' coincides with ip on [m]. □ 

Lemma 6.2. (V*,p) is a compact metric space. 

Theorem 6.1. Let W be a dissociated exchangeable rewiring map. Then, with probability 
one, \W\ exists and is nonrandom. 

We delay the proofs of Lemma 6.2 and Theorem 6.1 until Section 10. 

Corollary 6.1. Let W £ Woo be an exchangeable random rewiring map. Then \ W\ exists 
almost surely. 

Proof. By Theorem 6.1, every dissociated rewiring map possesses a nonrandom rewiring 
limit almost surely. By the Aldous-Hoover theorem, W is a mixture of dissociated 
rewiring maps and the conclusion follows. □ 

By Lemma 6.1, any v £ V* determines a probability measure Ll v on Woo hr a straight- 

(n) 

forward way: for each n £ N, we define Lib ' as the probability distribution on W n with 

f l^\w) :=v(w), »eW„. (6.10) 

Proposition 6.1. For any v £ V*, {fi^} is a collection of exchangeable and consis¬ 
tent probability distributions on {W n } ng N. In particular, {nl n ' ) } ng N determines a unique 
exchangeable probability measure Ll v on Woo for which Ll v -almost every w £ Woo has 

|ui| = V. 

Proof. By Lemma 6.1, the collection {Sl[T'} ng N in (6.10) is a consistent family of prob¬ 
ability distributions on {W„} rag N. Exchangeability follows because ind(w;, W*!^]) is in¬ 
variant under relabeling of w , that is, ind(ui,W*) = ind(w cr , W*!^) for all permuta¬ 
tions <7 £ Lf m and o' £ 5f n . By Kolmogorov’s extension theorem, {fl[, n *} ng N determines 
a unique measure Ll v on the limit space Woo- Finally, W ~ Ll v is dissociated and so, by 
Theorem 6.1, | W| = u almost surely. □ 

We call Ll v in Proposition 6.1 a rewiring measure directed by v. For any measure T 
on V*, we define the Y-mixture of rewiring measures by 

[ fl v (-)T(dv). 


v* 


( 6 . 11 ) 
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Corollary 6.2. To any exchangeable rewiring map W, there exists a unique probability 
measure T on V* such that W ~ fix ■ 

Proof. This follows by the Aldous-Hoover theorem and Proposition 6.1. □ 

From Theorem 6.1 and Proposition 6.1, any probability measure T on V* corresponds 
to an flx-rewiring chain as in Theorem 5.1. 


7. Continuous-time rewiring processes 

We now refine our discussion to rewiring chains in continuous-time, for which infinitely 
many transitions can “bunch up” in arbitrarily small intervals, but individual edges jump 
only finitely often in bounded intervals. 


7.1. Exchangeable rewiring process 


Henceforth, we write id to denote the identity Goo —> Goo and, for ngN, we write id„ to 
denote the identity Gn Gn- Let w be an exchangeable measure on Woo such that 


w({id}) = 0 and w({He>Voo: W|[ n ] ^ id„}) < oo for every n > 2. (7.1) 

Similar to our definition of P u in Section 5, we use w to define the transition rates of 
continuous-time w-rewiring chain. Briefly, we assume w({id}) = 0 because the identity 
map Goo —> Qoo is immaterial for continuous-time processes. The finiteness assumption 
on the right of (7.1) ensures that the paths of the finite restrictions are cadlag. 

For each n £ N, we write to denote the restriction of w to W„ and define 


(V")({WeW„: W(G) = G'}), G^G'eGn, 
\ o, G = G' eGn- 


(7.2) 


Proposition 7.1. For each n £ N, qff L ' > is a finite, exchangeable conditional measure on 
Gn- Moreover, the collection {q ^} n >2 satisfies 

qi m \G,G') = q^\G*,R m ] n (G / )), G^G'eG m , (7.3) 

for all G* £ R“ 1 „(G), for all m <n, for every n £ N, where R mj „ is the restriction map 
Gn —>■ Gm defined in (4-2). 

Proof. Finiteness of qjff' 1 follows from (7.1) since, for every G £ Gn-, 


<£ n) (G, Gn) = qL n) (G , Gn\{G})=J n H{W£W n : W(G) + G}) < w< n > ({W ± id„ }) < oo. 
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Exchangeability of q!f l> follows by Proposition 5.1 and exchangeability of ui. Consistency 
of {q^}n >2 results from Lipschitz continuity of rewiring maps (Proposition 4.1) and 
consistency of the finite-dimensional marginals {w( n )} raS N associated to to: for fixed G ^ 
G' G Q m and G* G R m („(G), 

q£\G*,R-] n (G'))= &\G\G") 

G":G"| [m] =G' 

= ^2 ^ n \{WeW n : W(G*) = G"}) 

G":G"| [ra] =G' 

= J n \{WeW n : W| [m] (G) = G'}) 

= w (m )({WG w m : W(G) = G’}) 

= q^\G,G’). □ 


From we define a collection of infinitesimal jump rates {Qi^jneN by 


Ql n \G,G') 


q£\G,G'), G'^G, 

-q^(G,g n \{G}), G' = G. 


(7.4) 


Corollary 7.1. The infinitesimal generators (Q^jneN are exchangeable and consistent 
and, therefore, define the infinitesimal jump rates Q u of an exchangeable Markov process 
on Qoo ■ 


Proof. Consistency when G' ^ G was already shown in Proposition 7.1. We must only 
show that Q is consistent for G' = G. Fix n G N and G G Q n - Then, for any G* G 

R n,n+i( G )> we have 

Qt +1 \G*,R2n + i(G)) = -q^ +1) (G*,g n+1 \{G*})+ £ qfr +1 \G*,G") 

G"eR- 1 „ + i(G):G"#G* 

= -g(r+ 1 ) ( G*,a„ +1 \ R -i„ +l( G )) 

= -9i n) (G,(? n \{G}) 

= QW(G,G). □ 

In Section 3, we mentioned local and global discontinuities for graph-valued processes. 
In the next two sections, we formally incorporate these discontinuities into a continuous¬ 
time rewiring process: in Section 7.2, we extend the notion of random rewiring from 
discrete-time; in Section 7.3, we introduce transitions for which, at the time of a jump, 
only a single edge in the network changes. Over time, the local changes can accumulate 
to cause a non-trivial change to network structure. 
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7.2. Global jumps: Rewiring 

In this section, we specialize to the case where ui = fix for some measure T on V* 
satisfying 

T({I}) = 0 and [ (l-vi 2) )T(dv)<oo, (7.5) 

Jv* 

where I is the rewiring limit of id £ Woo and vi 71 ' 1 := u(id„) is the entry of v corresponding 
to id„, for each n £ N. For each n £ N, we write qf^ to denote qlf 1 ' 1 for ui = fix, and 
likewise for the infinitesimal generator ■ 

Lemma 7.1. For T satisfying (7.5), the rewiring measure fix satisfies (7.1). 

Proof. By Theorem 6.1, T({I}) = 0 implies fix ({id}) = 0. We need only show that 
f v ,( 1 — rE)Y(dv) < oo implies fl^({W £ W„: W ^ id„}) < oo for every n> 2. For 
any v £ V*, 

f! V ({W £ Woo: W|[n] ^ id„» = fl„ ( (J {W £ W.: W\ {iJ} ± id {iJ} } 

'1 <i<j<n 

< Y, WeWoo: W\ {itj} ?id {i>j} }) 

= E ^ 2) (W2\{id 2 }) 

l<£<j<n 

= d!!_l)( i-„?>). 

Hence, by (7.5), 

n r ({W £ Woo: W | W # id„}) < J. - ^ 2 ) )T(dz;) < oo, 

for every n> 2. □ 

Proposition 7.2. For each n £ N, q^ is a finite, exchangeable conditional measure on 
Q n . Moreover, {q^} n e n satisfies 

q ( ™\G, C) = q^\G\ Ri(G')), G^G" £ Q m , for all G* £ R~] n (G). 


Proof. This follows directly from Propositions 6.1, 7.1, and Lemma 7.1. 


□ 
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We may, therefore, define an infinitesimal generator for a Markov chain on Q n by 


Q { r\G,G') 


q { r\G,G'), G'^G, 

~q ( r\G,Gn\{G}), G 1 = G. 


(7.6) 


Theorem 7.1. For each T satisfying (7.5), there exists an exchangeable Markov process 
T on Qoa with finite-dimensional transition rates as in (7.6). 


We call T in Theorem 7.1 a rewiring process directed by T, or with rewiring mea¬ 
sure fir- 


7.3. Local jumps: Isolated updating 


For i' > j' > 1 and k = 0,1, let R^,-, 

denote the rewiring map Woo —> Woo 

that acts by 

mapping G M- G' := R^AG), 




GiJ ■= 

fGij, 

\k, 

ij ^ i'j', 
ij = i'j'. 

(7.7) 


In words, Ftf) puts an edge between i and j (if k = 1) or no edge between i and j (if 
k = 0) and keeps every other edge fixed. 

For fixed n £ N, let 0„ £ Q n denote the empty graph , that is, the graph with no edges. 
We generate a continuous-time process T 0 := {r 0 (t)}t>o on Q n as follows. First, we specify 
a constant Co > 0 and, independently for each pair {i,j} £ [n] x [n], i < j, we generate 
i.i.d. random variables from the Exponential distribution with rate parameter Co- 
Given we define To by 

* ~r 0 (t) J ^—** -L? < ^ 

where i j denotes an edge between i and j in G. Clearly, To is exchangeable and 
converges to a unique stationary distribution 5 i n , the point mass at the complete graph 
l ra . Moreover, the distribution of T*, the time until absorption in l n , is simply the law 
of the maximum of n(n — l)/2 i.i.d. Exponential random variables with rate parameter 
c 0 . 

Conversely, we could consider starting in l n , the complete graph , and generating the 
above process in reverse. In this case, we specify Ci > 0 and let {T I? } 7< y be an i.i.d. 
collection of Exponential random variables with rate parameter ci. We construct Ti := 
{ri(t)} £ > 0 , given {T ^} i<j , by 


^ ~ri(t) j ^ ^ Tij > t. 

For Ci = Cq, this process evolves exactly as the complement of Tq, that is, 


Id =c To, 
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where r 0 := {r 0 (i)}t>o is defined by 

* ~r 0 (i) J **T 0 (t)j, 


for all iy^j and all t> 0. 

It is natural to consider the superposition of To and Ti, which we call a (co, ci) -local- 
edge process. Let co,ci >0 and let 5)) denote the point mass at the single-edge update 
map R$j. Following Section 7.1, we define 

^co, Cl := Co <5°- + Cl Y2 4■ (7-8) 

i<j i<j 

Lemma 7.2. For c Q ,ci > 0, fl COjCl defined in (7.8) satisfies (7.1). 

Proof. Since f2 COiCl only charges the single-edge update maps, it is clear that it assigns 
zero mass to the identity map. Also, for any n G N, the restriction of R^- to W n coincides 
with the identity Q n —> Q n except when 1 < i < j < n. Hence, 

({W G W„: W ^ id„}) = ^"-^ (co + cr) < 00 , 


for every n> 2. □ 

Corollary 7.2. For any co,ci > 0, there exists an exchangeable Markov process on Goa 
with jump rates given by fl CoCl . 

Proof. For every n £ N, the total jump rate out of any G £ Gn can be no larger than 

n(n— 1) . , 

---(c 0 Vci) <oo, 

and so the finite-dimensional hold times are almost surely positive and the process on 
G n has cadlag sample paths. The Markov property and exchangeability follow by inde¬ 
pendence of the Exponential hold times {7ij}i<i<.j<ra and Corollary 7.1. Consistency is 
apparent by the construction from independent Poisson point processes. This completes 
the proof. □ 

Definition 7.1. For any measure T satisfying (7.5), co,ci > 0, we call a rewiring pro¬ 
cess with jump measure ui = fir + H COiCl cm (T, Co, Ci)-rewiring process. 

From our discussion in this section, the (T, Co, Ci)-rewiring process exists for any choice 
of T satisfying (7.5) and co,ci > 0. Individually, fly and 0 CoCl satisfy (7.1) and, thus, 
so does oj := fir + H COjCl . Furthermore, the family of (T,Co,Ci)-rewiring processes is 
Markovian, exchangeable, and consistent. 
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We can construct an (T, Co, Ci)-rewiring process from a Poisson point process. For uj := 
fix + fico,ci) where T satisfies (7.5) and co,ci > 0, let W := {(f, W t )} C R + x Woo be a 
Poisson point process with intensity d t®w. To begin, we take To to be an exchangeable 
random graph and, for each n G N, we define P^ := (r [” ] ) t >o on Q n by P[, nl := P 0 |[ n ] and 

• if t > 0 is an atom time of W such that w\ n ^ := Wt|r„i ^ id„, then we put r["^ := 

Wfklfj); 

• otherwise, we put =P[’^- 

Proposition 8.1. For each n € N, is a Markov chain on Q n with infinitesimal jump 
rates Qin (7.f). 

Proof. We can define Wi n l := {{t,W^)} C R + x W„ from W by removing any atom 
times for which w\ n ^ := Wt|r n ] = id n , and otherwise putting w\ n ^ := Wt|r n ]. By the thin¬ 
ning property of Poisson point processes, is a Poisson point process with intensity 

dt (g> oj n , where 

w n (-):=w (n) (-\{idn}). 

Given r[ n ^ = G, the jump rate to state G' ^ G is 

uj n ({WeW n : W(G) = G'}) = Q^\G,G '), 

and the conclusion follows. □ 

Theorem 8.1. For any u> satisfying (7.1), the to-rewiring process on exists and can 
be constructed from a Poisson point process with intensity d t®ui as above. 

Proof. Let W be a Poisson point process with intensity dt®uj and construct {r^} ne N 
from the thinned processes {W[”1 }«gn determined by W. By Proposition 8.1, each 
is an exchangeable Markov chain governed by . Moreover, {r^ n l} ng N is compatible 
by construction, that is, r[ m ' = Rm^r^ for all t > 0, for all m < n; hence, {r^}„ g pj 
defines a process T on Q^. As we have shown previously, the infinitesimal rates given 
by are consistent and exchangeable; hence, T has infinitestimal generator Q u 

and is an w-rewiring process. □ 

8.1. The Feller property 

Any Markov process T on C?oo is characterized by its semigroup (Pt)t>o, defined as an 
operator on the space of continuous, bounded functions h: C/oo —> M by 


Pth(G)~E G h(T t ), GeG oo 


( 8 . 1 ) 
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where Eg denotes the expectation operator with respect to the initial distribution Sg(- ), 
the point mass at G. We say T has the Feller property if, for all bounded, continuous 
functions h: Goo —> R, its semigroup satisfies 

• P th(G) -¥ h(G ) as t j, 0 for all G G Goo, and 
t Pf/i(G) is continuous for all t > 0. 

Theorem 8.2. The semigroup (P^)t>o of any tv-rewiring process enjoys the Feller prop¬ 
erty. 

Proof. To show the first point in the Feller property, we let G G Q 0a and T := (r t ) t >o be 
an w-rewiring process with initial state To = G and directing measure u satisfying (7.1). 
We define 

T := {h: Goo —> R | there exists n G N such that G|[ n ] = G '|[ n ] =>• h(G) = h(G')}. 

By (7.1) and finiteness of Gn , r[ n ^ —>• G|[ n ] in probability as 1 4,0, for every n G N. Thus, 
for any h G T, let N G N be such that 

d(G,G')<l/N =3- h(G) = h{G'). 

Then rj^ —> G|[jv] in probability as t f 0 and, therefore, P t h(G) —y h{G) by the Bounded 
Convergence theorem. Right-continuity at zero for all bounded, continuous h: Goo K 
follows by the Stone-Weierstrass theorem. 

For the second point, let G, G' G Goo have d(G, G') < 1 /n for some n G N and construct 
T and T / from the same Poisson point process W but with initial states To = G and 
Tg = G'. By Lipschitz continuity of the rewiring maps (Proposition 4.1), T and T' can 
never be more than distance 1 jn apart, for all t > 0. Continuity of P“, for each t> 0, 
follows. □ 

By the Feller property, any w-rewiring process has a cadlag version and its jumps are 
characterized by an infinitesimal generator. In Section 7, we described the infinitesimal 
generator through its finite restrictions. Ethier and Kurtz [15] give an extensive treatment 
of the general theory of Feller processes. 

9. Concluding remarks 

We have presented a family of time-varying network models that is Markovian, exchange¬ 
able, and consistent, natural statistical properties that impose structure without intro¬ 
ducing logical pitfalls. External to statistics, exchangeable models are flawed: they pro¬ 
duce dense graphs when conventional wisdom suggests real-world networks are sparse. 
The Erdos-Renyi model’s storied history cautions against dismay. Though it replicates 
little real-world network structure, the Erdos-Renyi model has produced a deluge of in¬ 
sight for graph-theoretic structures and is a paragon of the utility of the probabilistic 
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method [5]. While our discussion is specific to exchangeable processes, the general descrip¬ 
tions in Sections 5 and 7 can be used to construct processes that are not exchangeable, 
and possibly even sparse. 

The most immediate impact of the rewiring process may be for analyzing information 
spread on dynamic networks. Under the heading of Finite Markov Information Exchange 
(FMIE) processes, Aldous [4] recently surveyed interacting particle systems models for 
social network dynamics. Informally, FMIE processes model a random spread of infor¬ 
mation on a network. Some of the easiest to describe FMIE processes coincide with 
well-known interacting particle systems, such as the Voter and Contact processes; others 
mimic certain social behaviors, for example, Fashionista and Compulsive Gambler. 

Simulation is a valuable practical tool for developing intuition about intractable prob¬ 
lems. Aldous’s expository account contains some hard open problems for time-invariant 
networks. Considering these same questions on dynamic networks seems an even greater 
challenge. Despite these barriers, policymakers and scientists alike desire to understand 
how trends, epidemics, and other information spread on networks. The Poisson point 
process construction in Section 8 could be fruitful for deriving practical answers to these 
problems. 


10. Technical proofs 

In this section, we prove some technical results from our previous discussion. 


10.1. Proof of Lemma 6.2 


We now show that (V*,p) is a compact metric space. Recall that V* is equipped with 
the metric 

p{v,v') = 'Y^2~ n E \ v v-v' v \, v,v'£V*. 

neN vew„ 

Since [0, l] w is compact in this metric, it suffices to show that V* is a closed subset of 

[0,l] w *. 

By Lemma 6.1, every v £ V* satisfies 

v{W) = ^2 v(W*) for every W £ W n 

W*eW„ + i:W*| [n] =W 


and 


E v(W) = l, 


wew n 

for all n€N. Then, for any x £ [0, l] w \ V*, there must be some TV G N for which 


£*:= E x (N) (W)- E z (JV+ 1 ) (fT) 

W*\ [N] =W 


>0. 
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For any 5 > 0, let B{x , S) := {x' G [0, l] w *: p(x, x') < 5} denote the (5-ball around x. Now, 
take any x' G B(x, 2~ n ~ 2 £ x ). By this assumption, p{x,x') < 2 ~ n ~ 2 e x and so 

2~ n Y \x (N) (W)-x , ( n \W)\ + 2- n - 1 Y \x (n+1) {W*)-x ,{n+1 \W*)\ 
W£W n w*ew N + 1 

< 2~ N ~ 2 e x ; 


whence, 

E |x (iV) (kF) -x'^ N) {W)\ < ^£ x and 

WGWn 

Y \x^ N+1) {W*)-x'^ N+1) {W*)\<^e x . 
w*ew jv+i 


By the triangle inequality, we have 


= y x (N) (w)~ y 


r : ( N + 1 \W*) 


WGWn 


w*-.w*\ [N] 


< E i* ( E^)-*' w wi + E E {x (N+1 \W*)-x'( N+1 \W*)) 

ffew» w ew N w*-.w*\ [N] =w 

+ Y x ,(N \W)- Y x ,(N+1) {W*) 

W£W n W*:W*\ [N ]=W 


<£x/4+ E E 


( N + 1 )(W*) _ r'( N + 1 )(W* 


WGWjv W*-.W*\ [N] =W 


E E 


r '(W+l)W* 


onl 


(W*) 


wewjv 


<£x/4 + £x/2+ E! 

weWiv 


W*:VK*| [w] =W 

®'W(w)- e 


c '(*H-i)(W*) 


W’*:W*| [JV] =W r 


Therefore, 


E x'^ N \W)~ Y x^ N+1 \W*) 

WEWn W:W*\ [n] =W 


>£ x /4>0, 


which implies x' G [0,1] w \ V*, meaning [0, l] w \ V* is open and V* is closed. Since 
[0, l] w is compact, so is V*. This completes the proof. 
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Assume that W is an exchangeable and dissociated rewiring map. By the Aldous-Hoover 
theorem, we can assume W is constructed from a measurable function /: [0, l] 4 — > {0,1} x 
{0,1} for which (i) f(a, ■, ■, •) = /(o', •, •, •) and (ii) /(•, b, c, •) = /(•, c, b, •)• More precisely, 
we assume Wij = f(a,r}i,r}j, for each i,j > 1, where {a; (r?i)i>i; are 

i.i.d. Uniform random variables on [0,1], Conditional on a = a, we define the quantity 

t«(V, W) := P{W\ [m] = V\a = a}, U £ W m ,m £ N, 

which, by the fact that W is dissociated, is independent of a; hence, we define the non- 
random quantity 


t(V, W) := E(l{W\ [m] =V}\ a)= P{W\ [m] = V}. 

Recall, from Section 6.2, the definition 

1 


x ind(U, W|[ n ]) 
t{V,W | w ):=- 


^4 m 


E 1 Wfn]= V >» " 


injections-?/;: [m] —> [n] 


For every n > 1, we also define 
1 


Affc, n := 


,m 


E E(l{W\f n] = V}\W\ [k] ), k = 0,1,...,n. 


injections-?/;: [m] —t [n] 

In particular, for every n £ N, we have 
1 


M °’ n ~ n^ m 


E E(l{W\f n] = V}\W\ [ 0 ] )=t(V,W) 

injections'?/;: [m] —> [n] 


and 

Mn,n = ^ E E ( 1 i W \[n] = ^ I ^Ih]) = W W\ [n] ). 

inj ections if ): [m] —> [n] 

We wish to show that t(V,W |[ n j) —» t(V,W) almost surely, for every V £ W m , m G N. 
To do this, we first show that (M 0| n, Mi >n ,... ,M n>n ) is a martingale with respect to its 
natural filtration, for every n G N. We can then appeal to Azuma’s inequality and the 
Borel-Cantelli lemma to show that —» t(V, W) as n —» oo. 

Note that 

Mk,n = ^ E E E(l{W\ [n] =w}\W\ [k] )l{w^ = V} 

injections-0:[m]—^[n] itiGW n 


and 


E(Mk+l,n | Mk,n) = E(E{Mk+ l, n | Mfc.n, W| [fc]) I Mk,n)- 
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On the inside, we have 


E(Mk+l, n | Affc.m W|[k]) 


= E (i E E 


injections i/):[m]4[n]w£Vy, 


->\.m 


E E i{^=n^(iwS, ] =«}|w r i w ); 


injections i/i:[m]4[n]i«6Wn 


whence, 


E(E(Mk + i tn | Mfc )7l , W|[fc]) | M k ,r, 


= E 


(i E E lK=V}f?(l{W|J l] =«;}|W|[ fc ])|M M ) 


injections i/>:[m]—>-[n] wEWi 


i 

n j,m 


E E H^ = V}E(E(l{W\ [n] =w}\W\ [k] )\M k , n ) 

injections ip:[m]— >[n] ^GlVn 


= ^ E E i(»*=n£(i{»'iw=«>}iA4.j 

injections ifj:[m]—>[n]wGWn 

= M k>n . 

Therefore, (Mk in )k=o,i,...,n is a martingale for every n G N. Furthermore, for every k = 

0,1,...,n — 1, 


|Affc+i, n ~ Mk, n \ 

E ^(i(wif B] =n i w\ [k+1] ) - E(i{w\f n] =v} i w| [fc] ) 

injections —>-[n] 

E i^(i{^if n] = n i w\ [k+1] ) - E(i{w\f n] = n i w\ [k] )\ 

injections ip:[m\— >-[n] 

< m(n — 

< m/n, 


1 

n j,m 


since E(1{W\f n] =V}\ hF|[fc+i])--E’(l{VF|j / ) ! [] =V}\ W\ [k] ) = 0 whenever ip does not map 
an element to k + 1. The conditions for Azuma’s martingale inequality are thus satisfied 
and we have, for every e > 0, 


i — - 


P{\M n>n - M 0 ,n\ > e} < 2 exp 


2 m 2 


for every n€N. 
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Thus, 

OO 

P{\M n>n -t(V,W)\ > e} < 2 exp 

n =1 n—1 

and we conclude, by the Borel-Cantclli lemma, that 
limsup{|t(F, W| [n ]) — t(V,W)\ > e} 

n—>• oo 

= {|i(V, bF|[n]) — t(V, W)\ > e for infinitely many n £ N} 

has probability zero. It follows that lim n _ ) . 00 t(V, W|r n i) = t(V, W) exists with probabil¬ 
ity one for every V 6 Therefore, with probability one, the rewiring limit 

(t(V,W0)v G w exists. We have already shown, by the assumption that W is dissociated, 
that t(V,W) is non-random for every V £ UmeN^mi hence, the limit (t(V,W))vew is 
non-random. This completes the proof. 
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